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Comparing the manner in which contestants' scores 
ware tabulated at both the liS5 ^erican Forensic Association 
National Individual Events Tournament (AFA--NIET) and National 
Forensic Association Individual Events Nationals (NFA^IEN) , a study 
(1) examined whether a cerralation anists between contestants placing 
in the guarterf inals with Jive ranks/five ratings (5R/SR) and those 
who would have placed with six ranks/six ratings (SR/6R)^ and (2) 
replicated an analysis suggesting that the AFA-NIET practice of 
dropping the low rank and low rating did not significantly alter tha 
group of contestants who would have advanced if all six ranks and 
ratings had been used. The results of the 1385 NFA-IEN and tha 
AFA-NIET ware recalculated using 6R/6R to datarmine the correlation. 
Results supported the previous study^ indicating that similar groups 
would have advanced using 6R/6R in the calculation as did using 
5R/5R* While contastants advancing to the quarterfinals in each 
contest were not significantly different, results showed that more 
were affected by the inclusion of fiR/SR at the NFA-IEN, Findings also 
showed that there was a greater shift in contestants* overall 
rankings at tha NFA^IEN. (Statistical tables are included.) (JD) 
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A COOTARISON OF TABULATION METHODS AT TWO 
NATIONAL INDIVIDUAL EVENTS TOURNAMENTS i 
THE AFA^NIET AND THE NFA IE NATIONALS 



Robert S, Littlefield 
North Dakota State University 



Although research in the area of tournament management has hean 
somewhat neglected j recent attention to this subject area at the 1985 
SCA Convention in Denver and the 1986 SCA Convention in Chicago has 
producad studies addressing issues related to the manner in which a 
contestant's scores are tabulated. One such study (Littlefield , 1986) 
suggested that the practice of dropping the low rank and low rating 
(not necessarily on the same. ballot) being utilised by the American 
Forensic Association at its National Individual Events Tournament 
did not signif ic.mtly alter the contestants who would have emerged if 
all six ranks and ratings would have been counted* 

A respondent to the study initially suggested that the two national 
tournaments being compared (AFA-NIET and Pi Kappa Delta) did not have 
sufficient ni^bers of students competing in the various categories to 
justify the conclusions reachad, Therefores fjo verify the findings, 
a national tournament with a larger number of contestants in each event 
was selected for analysis and comparison. The rationala for this criticism 
of the original study had at its base the argmnent that at a larger 
national tournament, there would be greater chances for atypical ranks 
or ratings being awarded by the judges. These atypical ranks or ratings 
would then justify the dropping of the low rank or rating. Also, because 
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of the larger judging pool required at a national tournament with more 
entries, judging praferences may skew the rankings and ratings even 
further » By dropping the low rank and low rating , these disparities may 
be accounted for and the appropriate contestants would advance to the 
elimination rounds. To find support for this position, the present study 
is designed to test the following hypothesis i 

Hp There is no correlation between contestants placing with six 
ranks/slK ratings (6R/6R) and those placing with five ranks/ 
five ratings C5R/5R) , 

There is a correlation between contestants placing with 6R/6R 

and those placing with 5R/5R, 
A high correlation would suggest that there was little difference in the 
CQntestants who advanced to quarterfinals* In other words ^ adding all 
six ranks and ratings would not have significantly altered the group of 
contestants advancing to the quarterfinal round, A low correlation 
would suggest that the drppplng of the low rank and low rating makes a 
difference j resulting in different people advancing in the contest* 

Method of Analysis 
To test the hypothesis, the results of the 1985 HFA IE Nationals 
and the results of the 1985 AFA-NIET were recalculated by adding all six 
ranks and ratings to determine advancement of contestants to the quarter- 
final round* The top 24 contestants after preliminary rounds of both 
national tournaments had already been determined using the 5R/5R system. 
The Spearman* s Rank Correlation Test (Daniel, 1978) was used to determine 
If there were correlations between those who advanced using the SR/SR 
system and those who would have advanced had all 6r/6R been included* 
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Results 

Initially, the earlier study had examined the number of contestants 
moving into and out of quarterfinals using the two-system format (sea 
Table 1). At the IE Nationals, Dramatic Duo, Prose Incerpretation , and 
Expository Speaking experienced the largest number of contestants affected 
by a change in computational method \:±th three who were in quartarf inals 
being replaced by three who would have been there had 6R/6R been used. 
Three events (Poetry Interpretation^ Communication Analysis, and Impromptu) 
had two who had originally advanced to quarterfinals being repiaced by 
two who had been excluded. Three events had one contestant replaced by 
others who would have benefitted if all 6r/6R had been included. No pre- 
liminary results wete distributed by the NFA for Dramatic Interpretation 
in 1985 » Therefore s this event was excluded from the analysis. 

Determining the quarterf inalists in each category had been completed 
at both National Tournaments by dropping the low rank and low ratings In 
this studys the quarterf inalists were reranked by adding all 6R/6R. Based 
upon pairs of scores for each contestant. Spearman's Rank Correlation was 
calculated for the different individual events (see Table 2). The correla- 
tion coefficients for the events at the AFA-NIET ranged from a low of 
,6615 (Extemporaneous Speaking) to a high of *9817 (Communication Analysis). 
At the NFA IE Nationals ^ the correlation coefficients varied from a low of 
.5822 (Prose Interpretation) to a high of .9983 (Extemporaneous Sp^ ing) , 
In general, each of the correlation coefficients were strong enough at 
alpha - ,005 to suggest that the inclusion of 6R/6R would not have produced 
groups of quarterf inalists who varied significantly. 

In the original study, the shift in rankings for those contestants 
moving into or out of the quarterf inalist category in each event varied 
from 20 to 27. At the NFA tournament, those affected by the inclusion of 



4 



4 

all six rankings and ratings varied in rank from 17 to 32 (see Table 3) 
It is worth noting that by including all scores for each contestant a i: 
the IE Nationals i students who had ranked as low as 35th would have ^ n 
able to move into the quarterf Inalis t category* These findings sup':-, 
the earlier contention that those placing highest and advancing int^'j 
quarterfinals in each event would have been relatively unaffected r - s 
inclusion of all 6R/6R and would have retained their "seed-- poslt;.-^. 

While substantiating the earlier study to the extent that conC^ ^t.^nr ^ 
did shift their positions within the quarterf inalist category j thfe paruian- 
taf/3 of contestants affected by a change in the seeding through the Inclu^ 
sion of six ranks and six ratings at the IE Nationals was generally at 
least four percentage points less in each category, with the exception of 
Poetry Interpretation and Communication Analysis where the percentage 
affected increased, and Dramatic Interpretation for which no results were 
available (see Table 4) • 

Conclus ions 

This study has been designed to replicata the earlier analysis which 
suggested that similar groups of contestants would have emerged into 
quarterfinal rounds without dropping the low rank and low rating at the 
APA-NIET, As the results have indicated^ it appears that the alternate 
hypothesis in this study must be accepted and the conclusion drawn that 
similar groups would have emerged at the NFA IE Nationals with the inclu- 
sion of 6H/6R. Therefore 5 as in the earlier study ^ the procedure of 
dropping the low rank and low rating should be reviewed in terms of its 
purpose and the time it takes to complete the process* 

There are some items that should be noted regarding some degree of 
variation between the AFA-NIET and the NFA IE Nationals. Initially, while 
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the groups of contestants advancing to the quarterfinals were not signi^ 
ficantly different statistically ^ more were affected by the inclusion of 
6R/6R at the NFA IE Nationals, In addition, there was more of a shift in 
overall rank for contestants moving into or out of award categories at: 
the NFA IE Nationals. One reason for these results may be the size of 
the contestant pools (see Table 5) , Due to the significantly larger 
number of contestants in each event at the IE Nationals ^ one could siiggest 
that there would be a greater chance for variation* Another reason for 
the difference might be related to the fact that in addition to fewer 
conteetants at the AFA-NIET, thosa who qualified for that tournament wera 
more homogeneous ^ in terms of general quality level due to the manner in 
which they qualified for the tournament,^ Because it is less difficult 
to qualify for the NFA IE Nationals ^ there may be more variation in 
experience level and consistency of performance for some of the contestants* 

The judging variation and style preference concerns may also be 
factors in the difference between the two national tournaments p as mentioned 
by critics of the earlier study* Certainly ^ the "psychological effect" 
developed in the original study which describes the relief f^lt by contes- 
tants who feared or were concerned about the rankings or ratings of parti"* 
cular judges would b^ potentially greater at a larger tournament with more 
contestants and judges. 

Directions for future research in this area might address the varia-- 
tion In rankings within the quarterfinal groupings. While seeding has not 
been shown to be a statistically valid way of predicting the ultimate winners 
in an events the use of this procedure might be further discussed and 
refined or eliminated. The self-reported anxiety on the part of contestants 
might also be explored when faced with judges who they perceive to be 
negatively inclined toward th«ii. To further explore the Sr/SR system versus 
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the 6R/6R system of rankings it may be useful to study the frequency of 
the ratings dropped* For eKatnplep are ranks of five most often dropped ^ 
or is there variation in this areap as well? 

The attention currently given to the tournament management tabulation 
procedures may provide the basis for greater understanding and more consis- 
tent application in years to come* Only if wa address the reasons why 
procedures are used will we be able to refine and use them appropriately. 
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ENDNOTES 

"At the AFA-NIIT, contestants may qualify in an event "at larga" 
by placing at thraa tournanients with a meld of nine (i.e., 1st placei 
2nd places and 6th planei 2nd places 3rd place , and 4th place| etc*) if 
ten schools are participating and the appropriate nimber of contestants 
are entered in the event (i^e,, 6 contestants for the 1st to count; IS 
for the 2nd to coLinti 20 for the 3rd to county 25 for the 4th| 30 for 
the 5th; and 35 for the 6th) , In addition ^ contestants may qualify at 
a District Tournainent where the top 10 percent of the contestants in 
each event (miniinum of three per event) advance to the National Tournainent* 
To qualify for the NFA IE Nationals j a contestant must compete in two 
preliminary rounds and a final rcund or finish in the top 10 percent of 
the contestants in an event with seven schools participating in the 
tournament. Contestants may not qualify unless twelve contestants are 
competing in the event* State championships or league contests are eKempte* 
from these requirements with prior approval of the executive council. 
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Table 1 



Different Methods of Ta 


Into and Out of 
bulation 


Quarterfinal Round Using 




iZi V ^ — & - — J 


AFA- 


-KIET 




NFA 


IE 


It lonals 




5R/5R to 


6R/6R 


5R/5R to 


6r/ 6R 


. ^ ^ 


N 


out 


in 
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out 


in 


Poatry Interpretation 


24 


1 


1 


24 


2 


2 


Dramatic Duo 


24 


1 


I 


24 


3 


3 


Coimnunication Analysis 


24 


0 


0 


24 


2 


2 


Prosa Intarpretat ion 


24 


2 


2 


24 


3 


3 


iKpository/ Informative 


24 


1 


1 


24 


3 


3 


After Dinner Speaking 


24 


1 


1 


24 


1 


I 


Impromptu Speaking 


24 


1 


1 


24 


2 


2 


Persuasive Speaking 


24 


1 


1 


24 


1 


I 


Extemporaneous Speaking 


24 


1 


1 


24 


1 


1 


Dramatic Intarpretation 


24 


1 


1 


Data 


unavallabla 
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Table 2 

Spaarman's Rank Correlation Coefficient Test Results 

Event Category AFA-NIET NFA IE Nationals 

5R/5R to 6R/6R 5R/5R to 6R/6R 



Poetry Interpretation *9238 ,8886 

Dramatic Duo *9515 ,8591 

Communication Analysis .9&17 •9891 

Prose Interpretation .9514 ,5822 

Expository/Informative ,9115 ,9757 

After Dinner Speaking ,9361 ,9961 

Impromptu Speaking ,8646 ,9843 

Persuasive Speaking ,8976 ,9787 

iKteraporaneous Speaking ,6615 ,9983 

Dramatic Intarpretation ,9169 Data unavailable 
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Table 3 



Shift in Overall Rank for Contestants Moving Into or Out of Award Categories 



Event Category 




AFA-NIET 




NFA IE Nationa 


Is 




Contestant 5R/5R 


to dK./dK 


won lss ti 


ant DK/jR to 


6B,/ 6R 






Rank 


Rank 




Rank 


Rank 


Poetry Interpretation 


A 


24 


25 


A 


20 


25 




B 


27 


23 


B 


23 


27 










C 


25 


23 










D 


■35 


22 


Dramatic Duo 


A 


23 


25 


A 


22 


25 




B 


25 


23 


B 


21 


26 










C 


23 


27 










D 


29 


24 










E 


32 


17 










F 


35 


22 


Coimnunication Analysis 


no 


shift occurred 


A 


22 


25 










B 


24 


27 










C 


25 


24 










D 


26 


23 


Prose Interpretation 


A 


23 


25 


A 


23 


28 




B 


24 


26 


B 


20 


31 




C 


25 


23 


C 


22 


32 




D 


26 


20 


D 


27 


19 










E 


31 


20 










F 


32 


21 


Expository/ Informative 


A 


23 


25 


A 


20 


27 




B 


25 


22 


B 


24 


29 










C 


22 


30 










D 


25 


22 










E 


26 


17 










F 


28 


19 


After Dinner Speaking 


A 


23 


25 


A 


24 


25 




B 


25 


23 


B 


26 


22 


Impromptu Speaking 


A 


24 


25 


A 


23 


26 




B 


25 


24 


B 


24 


27 










C 


25 


23 










D 


29 


24 


Persuasive Speaking 


A 


24 


27 


A 


23 


25 




B 


26 


21 


B 


25 


18 


Extemporaneous Speaking 


A 


24 


25 


A 


24 


26 




B 


26 


22 


B 


25 


24 


DramatiG Interpretation 


A 


22 


27 


Data 


unavailable 






B 


25 


22 
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Table 4 



Parcentage of Contestants Ixperiencing a Change in Ranking Dua to the Use 
of an Alternative Tabulation Method 



Event Category AFA-NIET NFA IE Nationals 

5R/5R to 6R/6R SR/SR to 6R/6R 



Poetry Interpretation 


21/24 




88% 


23/24 




96% 


Dramatic Duo 


22/24 




92% 


20/24 




83% 


Connnunication Analysis 


12/24 




50% 


22/24 




92% 


Prose Interpretation 


23/24 




96% 


20/24 




83% 


Expository/Informative Speaking 


23/24 




96% 


20/24 




83% 


After Dinner Speaking 


20/24 




83% 


18/24 




75% 


Impromptu Speaking 


21/24 




88% 


18/24 




75% 


Persuasive Speaking 


20/24 




83% 


19/24 




79% 


Extemporaneous Speaking 


20/24 




83% 


19/24 




79% 


Dramatic Interpretation 


21/24 




88% 


Data unavailable 
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Table 5 

Contestants Enterad by Event in 1985 

Event Category AFA-NIET NFA IE Nationals 



Poetry Interpretation 
Dramatic Duo 
Connnunlcation Analysis 
Prose Interpretation 
Expository /Inforinative Speaking 
After Dinner Speaking 
Impromptu Speaking 
rerauasive Speaking 
EKtemporaneous Speaking 
Bramatlc Interpretation 



112 231 

81 168 

50 129 

120 282 

87 179 

64 164 

91 222 

81 202 
76 145 

82 Date unavailable 
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